-
Notifications
You must be signed in to change notification settings - Fork 29.1k
[SPARK-21524] [ML] unit test fix: ValidatorParamsSuiteHelpers generates wrong temp files #18728
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Test build #79920 has finished for PR 18728 at commit
|
|
Hm, is the more basic error here that |
|
Thanks for your attention. @srowen Removing the SparkFunSuite will cause the === failed in the |
|
What about only extending, say, |
|
Yes, that's good. But I just found there's one rule in the scala style check |
|
How about extending just |
|
That appears to be all right. Sending update. |
|
Test build #79941 has finished for PR 18728 at commit
|
|
merged to master |
What changes were proposed in this pull request?
jira: https://issues.apache.org/jira/browse/SPARK-21524
ValidatorParamsSuiteHelpers.testFileMove() is generating temp dir in the wrong place and does not delete them.
ValidatorParamsSuiteHelpers.testFileMove() is invoked by TrainValidationSplitSuite and crossValidatorSuite. Currently it uses
tempDirfromTempDirectory, which unfortunately is never initialized since theboforeAll()ofValidatorParamsSuiteHelpersis never invoked.In my system, it leaves some temp directories in the assembly folder each time I run the TrainValidationSplitSuite and crossValidatorSuite.
How was this patch tested?
unit test fix